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INTRODUCTION 


Most  "how-to"  guides  start  from  the  beginning  and  work 
forward.  This  one  works  backward.  It  starts  with  a number 
of  common  CAI  author  "myths"  (misconceptions)  and  their  griz- 
zly consequences,  then  works  backward  to  how  the  matter  might 
better  have  been  approached  in  the  first  place.  For  this 
reason,  this  guide  is  not  so  much  an  attempt  to  instruct  as 
to  forewarn. 

Part  of  the  problem  with  being  a beginner  at  anything  is 
the  fact  that  you  don’t  always  know  what  questions  to  ask  or 
recognize  the  times  when  there  are  decisions  to  be  made. 

Thus,  our  intention  here  is  not  only  to  unearth  some  miscon- 
ceptions, but  to  map  out  essential  decision  points  in  lesson 
development.  We  don’t  claim  that  these  are  al 1 the  decisions 
you  will  ever  need  to  make,  but  dealing  at  minimum  with  these 
decisions  alone  should  help  you  write  effective  lessons.  We 
also  don't  claim  (or  intend)  that  this  will  provide  all  the 
instruction  you  need  for  coping  with  these  decisions.  Our 
main  intent  is  to  present  ways  to  think  about  each  of  the 
topics  presented. 

As  you  go  through  each  section,  bear  in  mind  that 
although  individual  topics  may  fall  under  only  one  heading, 
this  is  not  a good  reflection  of  the  real-life  development 
process.  Most  topics  spill  over  into  others.  One  aspect  of 
writing  this  sort  of  guide  is  a persistent  feeling  of  always 
overlapping.  Starting  on  one  topic,  we  inevitably  found  our- 
selves saying,  "Well,  yes  but  you  can't  really  talk  about  X 
without  also  talking  about  Y."  And  on  it  would  go.  So  if  you 
begin  to  get  the  feeling  you've  heard  this  all  before,  you 
probably  have. 

One  final  comment:  as  unbelievable  as  it  may  seem,  all 
the  anecdotes  related  here  are  true.  They  come  from  a vari- 
ety of  training  and  educational  settings.  As  well-intentioned 
as  authors  are,  anyone  can  fall  prey  to  these  pitfalls. 
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It  is  3:30  in  the  afternoon.  For  the  last  half  hour  or 
so  the  instructor  and  the  32  students  in  classroom  B of  the 
Paramedical  Training  Center  have  been  continuing  a discussion 
on  capillary  fluid  flow  that  began  at  their  last  session. 
Congregated  in  the  farthest  few  seats  of  the  first  and  second 
rows  are  "the  brains"  of  the  class.  They  understand  capil- 
lary fluid  dynamics  perfectly . Indeed , they  understood  it 
perfectly  when  they  came  to  class.  As  the  discussion  wears 
on,  they  become  increasingly  bored  and  irritated  at  the 
thought  that  they  have  to  sit  through  seemingly  interminable 
repetitions  of  the  same  points.  They  slouch  in  their  seats, 
doodling  in  their  no tebooks  or  staring  day  dreamily  out  the 
windows . 

In  the  back  of  the  room  are  the  slowest  students.  They 
are  so  thoroughly  confused  they  don’t  even  know  what  ques- 
tions to  ask.  The  most  they  can  manage  is  a disheartened,  "I 
don’t  get  it."  They  are  acutely  aware  that  they  are  the  only 
people  in  the  room  who  aren't  following  the  discussion. 

Mainly  they  feel  "stupid"--so  much  so  that  they  won’t  take 
the  risk  of  asking  what  they  fear  would  be  a "dumb"  question . 
They  slouch  in  their  seats,  doodling  in  their  notebooks,  or 
staring  discouragedly  out  the  windows. 

Most  of  the  students  have  been  concentrating  and  follow- 
ing the  spirit  if  not  the  letter  of  the  discussion.  Their 
comprehension  ebbs  and  flows  throughout  the  session  like  a 
music  box  running  down  and  being  rewound  again.  Each  feels 
s/he  understands  certain  elements , but  how  the  components  fit 
together  into  a whole  is  still  a little  murky  in  most  of 
their  minds.  Capt.  Stephens,  the  instructor,  is  going  over 
a problem  on  the  board  for  the  third  time.  She  is  racking 
her  mind  to  think  of  yet  another  way  to  restate  the  same  con- 
cept. She  also  knows,  however,  that  she  can't  afford  to 
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' spend  much  move  time  on  this  topic.  She  has  to  cover  capil-  j 

• ‘ j 

e lary  fluid  flow  before  the  semester  is  over.  A number  of 

' * 

; " ‘ students'  hands  are  up  and  Capt.  Stephens  calls  on  one  say- 

i C,i  \ 

If  ing,  "Ok,  we  only  have  tvme  for  one  more  questvon."  j 

"I  still  don’t  understand  how  you  can  add  pressure  and  j 

come  out  with  a negative  pressure . " 

; A few  hands  go  down,  and  students  nod  in  shared  bewil- 

? derment . 

"Ok,  Sgt.  Jensen,"  Capt.  Stephens  asks,  "what  will  hap- 
* pen  if  we  increase  the  ambient  pressure  in  this  case  to..." 

, 4s  she's  talking  Sgt.  Slack  is  glad  she  didn't  ask  him. 

He  doesn't  know  the  answer.  Neither,  as  it  turns  out  does 
. Sgt.  Jensen,  but  Jensen  comes  up  with  an  alternative  Slack 

would  never  have  thought  of.  Capt.  Stephens  analyzes  why  it’s 
S wrong,  and  in  doing  so  clarifies  the  point  for  a number  of 

other  students . 

After  finishing  her  explanation,  Capt.  Stephens  turns 
and  scans  the  students’  faces.  Only  a couple  of  those  who 
posed  the  original  question  still  look  puzzled. 

"Does  that  make  more  sense  now?" 

Enough  students  nod  so  that  Capt.  Stephens  feels  the 
class  is  ready  to  move  on.  She  's  aware  that  a number  of  stu- 
dents are  beiyig  left  behind,  but  this  topic  has  already  taken 
more  time  than  she  had  anticipated,  and  the  end  of  the  semester 
is  nearing . 

"Ok,  do  the  remainder  of  the  problems  to  be  handed  in 
the  next  time  we  meet.  Anyone  who's  still  confused  can  talk 
to  me  after  class.  Now  in  the  time  that’s  left  I want  to  get 
started  on. . . " 


In  a small  lecture  room  hundreds  of  miles  away  an 
instructor  is  delivering  his  26th  annual  lecture  on  the  work- 
ings of  the  fuel  injection  system.  Occasionally  he  looks  up 
for  a cursory  scrutiny  of  the  students'  faces.  A couple  of 
students  are  asleep  in  the  back,  but  most  are  diligently 
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scribbling  down  his  every  word.  He  wonders  whether  he's 
going  too  fast  or  too  slow  or  just  right.  He  wonders  whether 
they  understand  the  mysteries  he's  laying  forth.  He  wonders 
what's  in  the  minds  behind  those  expressionless  faces  look- 


ing back  at  him. 


If  you're  a former  instructor,  you've  probably  had  lots 
of  experience  with  students  in  a classroom  situation.  If  you 
haven't  taught,  you've  still  had  lots  of  experience  as  a stu- 
dent yourself.  Either  way  you're  well  acquainted  with  vari- 
ous classroom  situations.  When  working  with  something  new 
and  unfamiliar  it's  only  natural  to  try  to  draw  on  whatever 
intuition  or  experience  you  do  have.  There's  the  rub.  There 
are  substantial  and  important  differences  between  CAI  and  any 
other  educational  medium.  Many  CAI  authors  (both  new  and 
experienced!)  feel  most  comfortable  "translating"  their 
understanding  of  the  conditions  of  one  medium  into  another, 
especially  if  they're  pressured  by  time  constraints.  That 
seems  reasonable,  but  unfortunately  most  classroom  technique 
doesn't  "translate"  very  well  onto  a computer.  For  example, 
we  have  encountered  a number  of  former  lecturers  who , after 
being  enchanted  by  the  potential  of  the  computer,  decided  to 
convert  much  of  their  material  to  CAI.  Unfortunately,  their 
lessons  turned  out  to  be  transcriptions  of  their  lectures. 
That  was  what  they  knew  best,  so  that's  what  they  did. 

Let's  look  again  at  the  preceding  scenarios  and  enumer- 
ate some  of  the  characteristics  of  the  classroom  and  lecture 
approaches . 

The  most  obvious  characteristic  of  classroom  instruction 
is  that  it's  group  paced.  Instruction  moves  along  at  the 
rate  at  which  the  majority  of  the  students  can  keep  pace. 
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This  naturally  means  that  a fair  amount  of  the  brighter  stu- 
1 .nts'  time  is  wasted  in  sitting  through  repetitions  of 
things  they  already  understand.  It  also  means  that  slower 
students  are  often  left  behind,  not  only  because  they  don't 
catch  on  to  the  material  as  auickly,  but  also  because  they're 
often  inhibited  about  asking  questions  and  "revealing"  their 
ignorance.  They  need  specific,  individual  help  but  are  often 
emharassed  to  ask  for  it.  However,  the  instructor  is  able  to 
look  around  the  room  and  visually  assess  students'  reactions 
to  what's  going  on  --  to  catch  any  furrowed  looks  of  perplex- 
ity, or  enthusiastic  nods  of  recognition. 

In  addition,  the  instructor  is  often  under  pressure  to 
cover  a predetermined  amount  of  material  in  a certain  length 
of  time,  and  is  thus  compelled  to  push  the  group  harder  than 
may  be  wise. 

An  advantage  of  classroom  instruction  is  information 
from  other  students'  mistakes.  Naturally,  wrong  answers  are 
wrong  for  a variety  of  reasons.  One  student  may  give  a wrong 
response  another  would  never  have  thought  of,  but  the  feed- 
back on  why  it's  wrong  can  be  useful  to  both  of  them. 

Finally,  in  a classroom  situation,  most  of  the  necessary 
practice  is  done  outside  the  classroom  where  the  instructor 
has  no  input  or  control  over  the  direction  the  student's 
thinking  is  taking. 


An  intermediate  French  class  is  rapidly  filling  class- 
room 106--the  CAI  classroom.  Students  enter,  sit  at  separate 
consoles  ( terminals ) and  begin  working  on  individual  lessons. 
Each  student  goes  through  the  required  lessons  at  his/her  own 
speed.  Thus,  some  students  have  nearly  finished  all  the  les- 
sons while  others  are  farther  behind. 

Carol  Fisher  is  working  on  a lesson  on  verb  conjugations. 
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The  j/2<.  form  of  a jane,  and  ' • l is  enjoy  i kj 

competing  against  the  computer.  She  has  been  through  this 
■■  aame  before,  but  since  she's  ahead  in  her  work , she's  decided 

v * 

\ to  start  the  dry  with  a little  recreation-- "playing " at 

conjugating  verbs.  Though  she's  a fast  learner  and  confident 
about  other  grammatical  matters,  she  feels  she  needs  the 
extra  practice  at  verb  conjugations . 

Stephen  Gardner  is  about  halfway  through  the  total  num- 
ber of  lessons  each  student  has  to  complete.  He's  had  trou- 
i ble  with  translating  and  is  working  on  a lesson  on  reading 

comprehension . He  answers  the  first  set  of  questions  and  the 
computer  applauds,  "Good  work , Stephen!  That  was  a tricky 
* passage  and  you  did  very  well."  However,  he  has  a little- 

trouble  with  the  next  reading,  and  the  computer  takes  him 
through  a thorough  analysis  of  the  portions  of  text  that  gave 
him  the  most  problem. 

Laura  Bowers  is  plodding  along  in  a lesson  on  partici- 
ples. Languages  are  not  her  forte  and  she's  doing  pretty 
poorly.  4s  she  works  through  the  lesson,  she  requires  not 
only  a good  deal  of  on-line  remediation,  but  also  consider- 
able assistance  from  the  instructor  who  handles  any  student 
problems  or  questions  that  arise  while  they're  working  on  the 
terminals.  Laura  is  aware  that  she  gets  much  more  individual 
help  in  this  setting  than  in  a classroom  situation,  and  is 
glad  of  it.  She  figures  she’d  never  pass  this  course  without 
it . 


The  most  obvious  characteristic  of  CAI  is  that  it's 
self-paced.  Students  are  freed  from  having  to  keep  up  with 
or  be  held  back  by  other  students.  If  a student  is  having 
difficulty  with  some  subject  or  concept,  his/her  comprehen- 
sion doesn't  have  to  be  sacrificed  to  the  group's  "moving 
ahead."  CAI  is  also  individualized  so  that  each  student's 
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particular  problems  can  be  dealt  with  separately  either  by 
on-line  remediation  or  instructor  assistance.  Since  a~l  stu- 
dents won't  require  the  same  amount  of  help,  the  instructor 
is  freed  to  spend  more  time  with  those  who  need  the  most 
attention. 

Using  CAI,  each  student  has  the  chance  to  answer  (and 
get  feedback  on)  each  question.  However,  students  can't 
learn  from  each  others'  wrong  responses.  Lessons  can  also  be 
structured  so  that  students  are  able  to  "practice"  (again 
with  specific  feedback)  until  they  feel  confident  of  whatever 
concept  they're  working  on.  Of  course,  the  computer  can  only 
respond  to  actual  student  input.  It  can't  see  the  student, 
so  it  can't  detect  those  bewildered  looks  instructors  are  so 
familiar  with. 

Since  CAI  is  different  f ■ om  other  instructional  media, 
you  will  need  to  make  some  decisions  BEFORE  you  begin  to 
write  a lesson.  Some  of  these  matters  were  topics  you  did 
not  even  have  to  think  about  in  traditional  instruction. 
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npciPE  WHY  CAT  IS  THF  BFST  ME  PIMM  FOR  THIS  LF.SSOfi . 

CAI  is  not  a treatment.  It  is  a medium.  It  has  much  tc 
offer  that  is  not  available  via  traditional  instructional 
vehicles.  If  used  appropriately,  it  can  he  extremely  effec- 
tive. If  used  inappropriately,  it  may  have  little  to  offer. 
After  you  have  chosen  a lesson  to  program,  stop  to  ask  your- 
self why  you  should  use  CAI.  You  may  want  to  generate  a lot 
of  exercises  for  a drill.  Perhaps  you  want  to  create  a dia- 
logue situation  in  which  the  student  has  verbal  exchanges 
with  a simulated  patient  or  client.  You  may  also  want  to 
provide  the  student  with  an  experience  which  is  not  feasible 
through  another  medium.  Your  students  may  vary  widely  in 
background  and  ability,  so  you  may  want  to  individualize 
instruction.  For  example,  you  may  want  to  provide  extra 
practice  exercises,  or  more  detailed  explanations  only  for 
those  students  who  need  the  help. 

How  Would  CAI  Be  A Disadvantage  For  You? 

Perhaps  it  will  take  too  long  to  produce  a lesson.  Per- 
haps the  material  can  be  taught  just  as  readily  by  some  other 
means,  such  as  a textbook  or  instructor.  It  may  be  that  the 
student  will  need  to  use  a reference  page,  and  it’s  too  hard 
to  go  back  and  forth  between  displays. 
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MYTH:  A NEW  AUTHOR  CAN  WRITE  A LEE HON  WITHOUT  PLANNING. 

An  author  at  a remote  site  had  just  returned  home  after 
a one-week  course  in  coding  which  also  included  a smattering 
of  instructional  design.  He  felt  challenged  by  and  enthusi- 
astic about  the  potential  of  CAI.  He  was  eager  to  begin 
writing  his  own  lessons.  He  thought  writing  lessons  was 
tremendously  creative  and  he  regarded  himself  as  a creative 
person . 

During  the  short  training  course,  staff  instructors  had 
stressed  the  importance  of  preplanning  as  the  first  step  in 
lesson  writing,  with  particular  emphasis  given  to  a fairly 
careful  construction  of  a list  of  the  things  the  author  act- 
ually wanted  the  student  to  be  able  to  do_  at  the  lesson's 
end.  During  the  training  course  the  author  had  seen  the 
importance  in  such  prior  analysis , but  once  he  got  home  and 
actually  began  writing  his  first  lesson, he  found  prior  plan- 
ning rather  tedious--a  little  like  having  to  practice  scales 
when  you  Want  to  play  Beethoven.  He  tried  to  decide  what 
material  should  be  included;  he  tried  to  plot  out  the  les- 
son's organization.  But  he  felt  stifled,  anxious  to  really 
get  down  to  "writing"  the  lesson.  He  finally  announced 
that  he  (being  so  highly  creative ) could  not  function  this 
way.  His  "technique"  would  be  to  sit  at  the  terminal  and 
"create"  in  a rather  improptu  fashion--ad  libbing  as  he  went 
along.  This  procedure  felt  much  more  comfortable.  And  after 
all,  he  knew  that  other  more  experienced  authors  often 
"improvised.  " Besides,  he  was  bursting  with  ideas--he  had 
seen  some  fascinating  games  and  wanted  to  write  a game;  he 
had  seen  some  dazzling  displays  and  wanted  to  create  some 
graphics . So  he  set  out,  spirits  high,  expectations  even 
higher.  He  struggled,  but  felt  invigorated  by  the  struggle. 
He  labored,  but  felt  challenged  by  the  labor.  He  rhapso- 
dized, "Writing  lessons  is  so  creative  and  personal--it's 
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like  giving  birth!" 

Slightly  over  a year  later , he  bore  a rambling , hop- 
scotching  , patchwork  of  a lesson 3 disjointed  and  discordant , 
a blend  of  mayhem  and  mediocrity . Throughout  the  year  most 
of  his  time  had  been  eaten  away  by  reworking 3 reshuffling 
and  rewriting  what  he'd  already  done.  New  material  was 
tacked  on  to  the  end  of  the  lesson  producing  a rather , "And- 
oh-yes-I-forgot-to-mention..."  effect.  He'd  constructed  a 
" game ",  but  the  rules  were  so  complicated  no  one  could  play 
it.  He  had  included  his  graphics } but  they  were  juvenile  and 
cartoonish . The  students  for  whom  the  lesson  was  written 
came  to  refer  to  it  as  "Sesame  Street". 


This  author  was  well-intentioned,  hard-working,  and 
enthusiastic,  but  he  was  ambushed  by  a number  of  designing 
"myths".  The  first  was  that  planning  and  writing  a lesson 
are  somehow  separate.  That's  like  saying  playing  the  flute 
and  learning  what  finger  positions  produce  what  notes  are 
two  different  things.  Naturally  creativity  plays  an  impor- 
tan  role  in  quality.  Just  knowing  finger  positions  is  no 
guarantee  that  a person  will  be  able  to  make  music  (though 
they  may  make  noise!).  However,  not  knowing  positions  is  a 
virtual  guarantee  that  they  won ' t make  music. 

No  one,  not  even  experienced  authors,  can  simply  sit 
down  and  write  a lesson  extemporaneously  without  some  plan 
in  mind  (if  not  on  paper)  for  what  they  want  to  do  and  what 
they  want  the  student  to  do.  While  it's  true  that  experi- 
enced authors  often  "compose"  at  the  terminal,  they  are  abl e 
to  (successfully,  at  least!)  only  because  they  have  a firm, 
broad  springboard  of  experience  on  which  to  rely.  Any  craft 
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is  grounded  in  a certain  set  of  skills  at  which  the  crafts- 
man must  be  proficient.  They  are  the  heart  of  the  craft. 

The  author  in  our  scenario  was  misled  by  the  outward  behav- 
ior of  other  more  experienced  authors.  He  only  saw  (and 
believed)  the  fact  that  they  were  able  to  "ad  lib"  a lesson 
on-line.  He  didn't  see  the  mental  organization  that  had 
gone  on  or  the  fact  that  they  were  able  to  "ad  lib"  only 
because,  having  written  a number  of  lessons,  they  had  prac- 
ticed and  become  proficient  at  the  necessary  skills.  Just  as 
one  would  not  expect  a jazz  artist  to  improvise  a piece  of 
music  without  having  a solid  musical  foundation  of  discipline 
and  understanding,  one  could  not  reasonably  expect  that  a 
"novice"  author  could  improvise  a lesson  without  a solid 
instructional  foundation  of  design  and  media  experience.  As 
a result  of  his  extemporizing  without  sufficient  planning, 
the  author  wound  up  spending  an  inordinate  amount  of  time 
redoing  huge  chunks  of  his  lesson,  dragging  lesson  develop- 
ment out  much  longer  than  was  warranted. 

Finally,  because  he  had  been  impressed  by  demonstrations 
of  some  interesting  games  and  graphics,  he  naturally  wanted 
to  incorporate  similar  techniques  into  his  lesson.  Gathering 
new  ideas  from  various  sources  is  certainly  a laudable 
approach,  but  he  tried  to  apply  techniques  for  their  own  sake 
rather  than  for  their  educational  effect.  The  net  effect  was 
that  they  were  considered  juvenile  and  inappropriate. 

Therefore,  the  best  approach  (especially  if  you're  not 
particularly  experienced  with  CAI)  is  to  plan  your  lessons 
before  you  begin  to  code  them.  In  order  to  do  that  you  will 
have  to  make  a number  of  decisions.  One  of  the  first,  con- 
cerns your  goals  for  the  student. 
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DECT  DR  ON  THE  GOALS  OF  THE  LESSON. 


Clearly  and  concisely  stating  what  you  expect  of  the 
student  is  one  useful  way  of  organizing  the  lesson  material 
both  in  your  own  mind  and  in  the  student’s  mind.  This  tech- 
nique can  help  you,  as  the  author,  pare  away  ir relevancies 
and  stucture  the  material  in  a less  rambling,  more  cohesive 
lesson.  State  expectations  as  precisely  and  unambiguously  as 
possible.  Look  at  the  following  examples: 

Bad  example:  "Know  the  names  of  the  parts  of  a truck 
engine . " 

Good  example:  "Match  the  names  of  the  parts  of  a truck 
engine  to  the  proper  places  in  a diagram,  with  95% 
accuracy . " 

The  terms  in  the  first  example  are  unclear  and  can  be 
easily  misunderstood.  What  does  the  author  mean  by  "know"? 
S/he  might  mean  "list"  the  parts  of  an  engine,  or  s/he  could 
mean  that  given  a drawing  of  an  engine,  the  student  will  name 
each  part.  The  second  example,  however,  clearly  conveys 
exactly  what  the  student  will  have  to  do.  Sometimes  goals 
can  not  be  stated  so  precisely,  or  in  exact  behavioral  terms. 
But  wherever  it's  possible,  rather  than  asking,  "What  do  I 
want  the  student  to  know,"  ask  youself,  "What  do  I want  the 
student  to  be  able  to  do?" 

In  addition  to  helping  you  organize  the  lesson  material, 
stating  specific  expectations  will  help  you  figure  out  how  to 
measure  whether  the  student  has  learned  what  you  had  hoped. 
Without  some  reliable  measurement  of  the  student's  post- 
lesson knowledge  or  skills,  you  won’t  know  whether  you've 
effectively  gotten  the  material  across. 
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DECIDE  HOW  YOU  ARE  GOING  TO  MEASURE  STUDENT  PERFORMANCE. 


What  Sorts  Of  Questions  Should  You  Use? 

The  questions  you  choose  depend  on  the  goals  you  have 
set.  For  example,  if  your  goal  is  for  students  to  memorize 
the  multiplication  tables  from  one  to  nine,  you  may  want  to 
use  some  sort  of  drill  to  measure  their  performance.  If  your 
goal  is  for  students  to  be  able  to  apply  Boyle's  Law,  you'll 
probably  want  to  construct  some  new  problems  in  which  stu- 
dents have  to  use  Boyle's  Law.  The  trick  is  to  be  sure  your 
questions  really  do  test  the  skills  you  intend.  For  example, 
suppose  the  student  answered  the  following  question  correctly: 

Type  the  number  of  the  correct  answer  — 


The  Pythagorean  Theorem  states  that  the: 

1.  hypotenuse  2 - the  sum  of  the  sides. 

2.  (sum  of  the  sides)  2 = the  hypotenuse. 

3.  hypotenuse  2 = the  sum  of  the  squares  of  the  sides. 
U.  hypotenuse  2 = (sum  of  the  sides)  2. 


The  most  you  can  infer  is  that  the  student  is  able  to  pick 
out  the  correct  answer  when  given  a choice.  You  cannot,  how- 
ever, extrapolate  that  the  student  is  also  able  to  state  the 
theorem  or  apply  it  in  a new  situation. 

How  Many  Questions  Should  You  Use? 

At  one  CAI  site,  end-of-lesson  tests  consisted  of  one 
test  item  per  concept  (much  to  the  horror  of  assorted  CAI 
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consultants!).  Though  there  really  is  no  good  rule-of-thumb 
for  deciding  on  the  number  of  items,  bear  in  mind  the  diffi- 
culty of  the  material  and  the  types  of  questions  you're 
using.  Passing  or  failing  one  item  doesn’t  tell  you  a lot 
about  the  student's  proficiency.  On  the  other  hand,  too  many 
items  can  frustrate  the  student. 
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MYTH:  PRESENTING  IS  TEACHING  (A  LESSON  IS  CONTENT) 


At  a university  CAI  site , the  director  decided  that  all 
project  lessons  should  be  evaluated  by  outside  content 
experts.  His  decision  was  roundly  applauded  by  friend  and 
foe  alike  as  a giant  step  toward  quality  control.  The  revo- 
lutionary director  constructed  a list  of  guidelines  for  any 


consultant  reviewing  the  lessons.  The  only  problem  was  that 
the  only  sorts  of  reviewer  comments  the  director  solicited  or 
allowed  for  were  content  questions.  In  fact  he  went  so  far 
as  to  specifically  request  that  no_  comments  be  made  about 
the  workings  or  design  of  the  lesson  itself. 

This  emphasis  on  content  alone  resulted  in  the  project's 
lessons  evolving  over  a period  of  time  into  "page- turners "-- 
heavily  textual , book-like  lessons  with  little  student  inter- 
action. Because  of  the  density  of  the  text , students  were 
strongly  encouraged  to  sit  at  their  terminals  and  take  notes. 
Most  did--so  thoroughly , in  fact , that  they  began  to  seem 
like  modern  day  scribes } conscientiously  transcribing  little 
books  of  their  own. 


DECIDE  WHAT  APPROACH  THE  LESSON  WILL  TAKE. 


The  beauty  of  a powerful  CAI  system  is  that  it  enables 
you  to  choose  from  among  many  teaching  styles.  You  can  use 
sophisticated  student/computer  interaction  to  provide  your 
students  with  experiences  that  are  not  otherwise  possible.  Of 
course,  the  traditional  text-laced-with-questions  technique 
is  also  a possibility,  and  many  new  authors  begin  there.  The 
point  is  that  many  alternatives  are  available.  You  can  use 
more  than  one  in  a lesson;  you  don’t  have  to  stay  with  a sin- 
gle approach  throughout.  Here  are  a few  examples  of  what  you 
can  do. 


Drills  --  cycle  students  through  a series  of  problems,  ques- 
tions, definitions,  etc.  Questions  can  be  given  in  the  same 
order  to  all  students  or  randomly  selected  from  a pool  of 
items.  You  can  also  cycle  students  back  through  those  items 
they  missed  for  extra  practice.  This  is  a good  technique  for 
reinforcing  rote  memory  skills  such  as  foreign  language 
vocabulary  acquisition,  spelling,  multiplication  tables,  spe- 
cialized terminology,  etc.  Acceptable  student  performance 
can  be  set  at  any  level,  depending  on  your  goals.  They  can 
range  from  a specified  percentage  to  total  mastery. 


Tutorials  --  lead  students  through  a socr 
logue.  This  is  a good  method  for  guiding 
some  process  or  problem-solving  situation 
you  can  use  tutorials  to  direct  a student 
other  hand,  students  usually  have  very  li 
this  situation,  and  can  sometimes  feel  fr 
sometimes  opt  for  using  tutorials  mainly 
type  situations  (after  the  student  has  ei 
basic  criterion  or  requested  help. 


atic  sort  of  dia- 
students  through 
As  the  author, 

's  thinking.  On  the 
ttle  autonomy  in 
ustrated.  Authors 
in  remedial  or  help- 
ther  failed  some 


17 


,,i  In_quirJ.es  --  basically  present  students  with  a "20  Questions" 

* situation  in  which  the  computer  presents  an  unknown  of  some 

| sort  (usually  chosen  at  random  from  a pool  of  possibilities), 

J and  students  must  ask  questions,  run  tests  on  the  unknown, 

etc.  to  determine  what  it  is.  This  method  has  obvious  appli- 
v cations  to  the  hard  sciences,  but  some  imaginative  authors 

can  find  applications  for  it  in  other  disciplines. 

Simulations  --  place  students  in  a controlled,  "real-life" 

V situation  in  which  they  must  bring  the  situation  to  some  sort 

of  resolution.  For  example,  there  are  many  clincial  simula- 
tions in  which  students  play  the  role  of  the  physician  and 
must  take  a patient  history,  do  a physical  examination, 
request  laboratory  information,  then  tie  all  the  information 
into  a diagnosis  of  the  patient’s  condition.  There  are  other 
simulations  in  which  students  play  the  role  of  a mediator  or 
other  person  in  a position  of  authority  who  must  settle  a 
labor  dispute,  negotiate  a peace  agreement  between  warring 
factions,  etc.  There  are  as  many  possibilities  as  there  are 
real-life  conflicts.  This  method  allows  the  student  to  make 
mistakes  which  might  be  critical  in  real-life,  but  are  innoc- 
uous in  the  controlled  environment  of  the  simulation.  It  can 
also  provide  the  student  with  a realistic  situation  or 
dilemma  s/he  might  otherwise  have  only  been  able  to  learn 
about  on  a theoretical  level.  This  is  also  an  excellent 
technique  to  use  when  your  goal  is  to  bring  about  attitudinal 
changes . 

There  are  also  other  sorts  of  simulations,  however.  You 
can  put  students  in  a simulated  laboratory  situation  in  which 
they  perform  some  experiment  or  laboratory  procedure,  the 
advantages  being  that  the  results  are  both  instantaneous  and 
harmless!  You  can  also  put  students  in  a predictive  simula- 
tion in  which  they  "plug"  data  into  a model  which  then  pre- 
dicts likely  outcomes.  An  example  is  a population  dynamics 
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model  in  which  the  student  feeds  in  information  on  birthrate, 
available  resources,  etc.,  and  the  model  plots  out  the  conse- 
£■',  q u e n c e s . 

Games  --  put  students  in  a situation  in  which  they  are  in 
competition  with  other  students,  the  computer,  the  clock,  or 
anything  else  you  can  think  of.  Games  may  be  realistic  or 
fanciful.  Games  are  useful  in  developing  numerous  skills, 
and  can  turn  learning  into  entertainment. 

How  Much  Control  Should  Students  Have? 

Students  should  have  the  option  of  going  back  to  review 
lesson  material  that  they  have  already  covered.  The  only 
potential  problem  is  that  students  sometimes  spend  so  much 
time  reviewing,  they  don't  finish  a lesson  in  a reasonable 
amount  of  time.  Your  student  data  (or  classroom  observation) 
will  tell  you  whether  a student  is  spending  too  much  time  in 
lessons  or  lagging  behind  in  the  curriculum.  At  that  point 
some  direct  intervention  may  be  the  best  course. 

Going  a step  further,  though,  if  the  lesson  material  is 
flexible  enough  so  that  order  is  unimportant,  consider  let- 
ting students  determine  their  own  path  through  the  lesson. 
Chances  are  that  students  who  are  unfamiliar  with  the  subject 
matter  will  tend  to  go  through  the  material  in  order  rather 
than  jump  back  and  forth.  However,  students  may  find  it 
helpful  to  be  able  to  skip  around  if  they  are  already  famil- 
iar with  the  material  or  want  to  review  previous  sections. 
This  can  be  handled  a number  of  ways.  You  can  provide  a les- 
son index  to  which  students  have  access  from  any  point  in  the 
lesson.  They  can  then  go  through  the  material  in  sequence  or 
vary  the  order.  If  you  want  a little  more  control  over  the 
course  students  take,  you  can  give  them  a series  of  more 
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ing  the  students'  progress  through  the  lesson 
en  more  important  when  you  allow  them  some  auton- 
ents  have  been  known  to  skip  parts  that  are  unin- 
or  too  difficult,  so  you  will  want  to  be  sure  that 
been  through  every  section  before  they  complete  the 


DECIDE  HOW  YOU  WILL  QUESTION  THE  STUDENT. 

CAI  is  similar  to  a private  tutor.  It  is  interactive 
and  it  allows  every  student  to  answer  every  question.  A pri- 
vate tutor  asks  questions  periodically  to  find  out  if  the 
student  understands  each  section.  The  tutor  provides  hints, 
explanation,  and  other  forms  of  remediation  as  the  need 
arises.  In  the  same  way,  the  CAI  lesson  can  ask  questions  to 
monitor  the  student's  understanding  and  to  provide  additional 
help  when  the  student  needs  it.  A big  difference  between  CAI 
and  tutoring  is  that  the  tutor  can  make  decisions  about  what 
to  ask  and  how  to  respond  as  he  works  with  the  student.  The 
author  of  a CAI  lesson  has  to  make  many  of  these  decisions 
before  students  try  the  lesson. 

What  Question  Formats  Should  You  Use? 


There  are  many  good  sources  with  detailed  analyses  of 
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the  pros  and  cons  of  each  question  form  over  the  others  (see 
reference  list).  In  our  present  context,  let  us  simply  reit- 
erate the  need  to  match  the  type  of  interaction  to  the  level 
of  student  competence  you're  aiming  for. 

Where  Should  You  Insert  Questions? 

Is  it  good  enough  to  wait  until  the  end  of  the  lesson? 
Emphatically,  NO!  That  may  seem  to  be  the  simplest  approach, 
but  in  reality  it  is  inefficient.  If  the  questions  at  the  end 
show  that  the  student  has  failed,  s/he  may  have  to  repeat  the 
entire  lesson  in  order  to  learn  those  parts  that  s/he  missed. 
In  fact,  if  later  material  depends  on  understanding  earlier 
content,  a student  who  does  not  learn  the  earlier  part  will 
be  unable  to  got  anything  out  of  later  parts  of  the  lesson. 

Questions  should  be  asked  both  within  the  lesson  and  at 
the  end  .^Where  you  put  them  within  the  lesson  depends  on  the 
nature  of  the  lesson,  and  the  age  and  ability  of  the  stu- 
dents. If  you  are  presenting  text,  and  there  is  a lot  of 
rgpding,  there  is  an  increased  tendency  for  the  student  to 
just  read  the  words.  Ask  questions  after  major  ideas  or  con- 
cepts are  presented  to  be  sure  the  student  is  alert  and 
learning  as  s/he  goes  along.  If  you  are  teaching  rules,  Rive 
the  student  some  practice  to  see  if  s/he  can  apply  the  rule. 

It  may  be  a good  idea  to  start  out  by  inserting  ques- 
tions or  practice  only  after  major  ideas.  After  you  try  the 
lesson  with  students,  you  will  find  cut  where  they  need  more 
help  and  you  can  add  more  practice  in  those  sections. 

DECIDE  HOW  TO  DISPLAY  THE  MATERIAL. 

How  Much  Should  You  Put  On  A Single  Display? 


Don't  give  students  too  much  to  look  at  at  one  time.  If 
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the  display  is  chock  full  of  things,  they  may  miss  the  most 
important  thing,  or  they  just  may  give  up  altogether.  If  you 
must  present  lots  of  text,  do  it  in  small  chunks.  Present  a 
few  lines,  then  ask  the  student  to  press  a key  to  get  a few 
more  lines  when  s/he  is  ready. 

/ 

How  Should  You  Highlight  Material? 

The  way  in  which  material  is  visually  presented  can  help 
or  hinder  the  student.  Sorting  text  visually  can  help  the 
student  sort  the  material  in  his/her  mind,  and  may  make  it 
easier  for  him/her  to  recall  it  later  on.  For  example,  if 
you  present  a number  of  points  in  a series,  numbering  them 
and  presenting  them  in  a vertical  column  may  make  it  easier 
for  the  student  to  remember  than  if  you  had  listed  them  in 
paragraph  form.  Underlining,  capitalizing  or  writing  in  dif- 
ferent script  can  also  highlight  important  words  or  ideas. 

How  Much  Time  Should  Students  Have  To  Read  A Display? 

People  read  at  different  rates.  It  is  usually  not  wise 
to  set  a specified  length  of  time  for  students  to  read  or 
look  at  a display.  Let  the  students  themselves  control  the 
timing.  For  example,  suppose  you  want  to  present  some  text 
and  an  illustrative  animation.  Students  can't  read  and  watch 
the  animation  at  the  same  time.  Have  them  press  a key  or 
indicate  in  some  way  when  they  are  ready  to  look  at  the  gra- 
phics. Sometimes  the  author  wants  to  retain  part  of  a dis- 
play, but  also  to  change  part  of  it.  Be  sure  to  make  it 
obvious  to  the  students  that  part  of  the  display  has  been 
changed.  If  you  rewrite  a few  lines  of  text  at  the  bottom  of 
the  display,  and  the  student  is  still  looking  at  the  top, 
s/he  will  more  than  likely  miss  the  fact  that  a change  took 
place. 
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THE  STUDENT  WELL  RESPOND  THE  WAY  YOU  ANTICIPATE. 


.4t  a CAI  site  on  a large  college  campus , a clinician  and 
a programmer  were  writing  a clinical  case  simulation.  The 
case  was  one  in  a series  of  simulations  for  which  the  "shell" 
had  already  been  programmed.  The  student's  goal  was  to  diag- 
nose and  treat  the  "patient's"  condition.  The  model  was 
designed  so  that  the  student  could  gather  a complete  patient 
history , do  a physical  examination  and  request  laboratory  data. 
It  was  an  easy  matter  to  plug  case  after  case  into  the 
preprogrammed  structure.  The  programmer  had  already  run 
students  on  a number  of  other  similar  cases  and  had  a fair 
idea  of  what  sorts  of  questions  or  responses  they  were  likely 
to  make. 

While  going  through  each  section  together , the  program- 
mer suggested  a number  of  plausible  student  responses  that 
needed  to  be  allowed  for.  The  clinician  balked , however , 
saying,  "Why  would  they  ask  that?  With  the  data  they  should 
already  have,  they  should  know  it  doesn’t  apply  to  this 
case!  " 

"Sometimes  students  are  befuddled  and  don't  know  what  to 
ask  next,  so  they  ask  a standard  question  hoping  it  will  turn 
up  some  clue.  Besides,  at  this  point  in  the  simulation  they 
may  not  have  asked  all  the  pertinent  questions  yet,  and  so 
don’t  realize  it  doesn't  apply,"  the  programmer  replied. 

"But  they  should  be  told  what  a stupid  question  that 
is!"  the  clinician  bellowed,  becoming  increasingly  irritated 
at  these  faceless,  exasperating  students. 

"This  is  a simulation,  though,  an  attempt  to  replicate 
real  life  as  much  as  possible . In  real  life  no  one  will  be 
there  to  monitor  or  censor  the  questions  they  ask  a patient. 
Part  of  the  point  here  is  for  them  to  learn  on  their  own  in 
the  safety  of  a simulated  situation  what's  relevant  and  what 
isn  ' t . " 
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"But  wit':  this  I t ■:  ' d never  ask  that  question!"  the 

ever-reddenin ■■  clinician  retorted. 

"That's  because  you 're  glrca ay  a physician.  You  can't 
expect  students  to  have  that  same  storehouse  of  knowledge  at 
this  point.  They  wouldn't  have  to  go  to  school  if  they  did," 
the  programmer  rejoined. 

"They  should  be  told  they  shouldn't  have  asked  such  a 
dumb  question,  that  it's  irrelevant,  and  that  they're  way  out 
on  a limb.  They  should  only  ask  the  questions  we've  already 
allowed  for!"  the  blustering  clinician  boomed. 

About  a week  later  the  clinician  stood  at  the  back  of  a 
classroom  smuggly  surveying  a group  of  students  going  through 
his  clinical  cases.  A number  of  students  were  stuck  and 
tried  various  responses , always  with  the  same  maddening 
result-- "You  shouldn't  be  asking  that!"  With  each  slap  on 
the  wrist,  the  students'  reactions  escalated  from  puzzlement 
to  frustration  to  out-and-out  anger.  The  normally  quiet 
classroom  began  to  reverberate,  the  sound  swelling  from  half- 
whispered  cursing  to  irritated  muttering  to  a clamoring  roar 
of  outraged  students  shouting  to  the  terminals,  to  themselves 
and  to  each  other. 

"How  in  the  $%*?!?  are  you  supposed  to  learn  anything 
around  here  when  all  you  get  is  these  $&!?*!  snide  remarks!?" 

"Who  was  the  #$*&!?%  turkey  who  came  up  with  this  lunacy 
anyway ? ! ? " 

"Yeah!!  Who  does  he  think  he  is  anyway?!" 

The  clinician  opted  for  a hasty,  unheralded  retreat . 


Students  aren't  mindreaders.  Neither  are  authors. 
Unless  you  become  an  orthodox  devotee  of  the  multiple-choice 
question,  you  will  sometime  have  to  confront  the  fact  that 
when  you  ask  people  to  respond  in  an  open-ended  manner,  they 


24 


|pr  w 

f.. 

(.  . 

f - 
|5-' 

l r 
' * ■< 


■r  V 


may  not  respond  as  you  hoped  or  anticipated  (especially  in 
"conversational"  settings  like  open-ended  clinical  simula- 
tions'). Of  course  you  will  want  to  set  a certain  level  of 
acceptability,  but  within  that  range  students  will  probably 
come  up  with  varied  and  surprising  responses.  That's  just 
fine.  Part  of  the  reason  for  putting  material  on-line  at  all 
is  to  individualize  --  to  cater  to  each  student's  needs  as 
specifically  as  possible. 

A big  part  of  your  problem  will  be  to  unravel  and  assess 
the  student's  thinking  as  s/he's  going  through  the  lesson. 
Eoth  you  and  the  student  need  to  know  how  s/he's  doing, 
whether  s/he's  grasping  the  material.  If  s/he's  having  trou- 
ble, s/he  needs  help  at  that  point,  not  after  s/he's  botched 
some  end-of-lesson  test.  This  is  especially  crucial  if  the 
lesson  material  is  in  some  hierarchy  in  which  concepts  build 
upon  each  other.  If  the  student  is  lost  at  some  link  in  the 
chain  of  concepts,  your  job  is  to  figure  out  where  s/he  is 
and  help  him/her  get  started  again.  The  student's  responses 
should  be  taken  seriously.  In  the  previous  anecdote,  the 
clinician  would  have  done  better  to  realize  that  if  the  stu- 
dent were  asking  seemingly  irrelevant  questions  s/he  was 
likely  floundering  around  and  in  need  of  help. 

A big  part  of  your  problem  will  be  to  unravel  and  assess 
the  student's  thinking  as  s/he's  going  through  the  lesson. 
Both  you  and  the  student  need  to  know  how  s/he’s  doing, 
whether  s/he's  grasping  the  material.  If  s/he's  having  trou- 
ble, s/he  needs  help  at  that  point,  not  after  s/he's  botched 
some  end-of-lesson  test.  This  is  especially  crucial  if  the 
lesson  material  is  in  some  hierarchy  in  which  concepts  build 
upon  each  other.  If  the  student  is  lost  at  some  link  in  the 
chain  of  concepts,  your  job  is  to  figure  out  where  s/he  is 
and  help  him/her  get  started  again.  The  student's  responses 
should  be  taken  seriously.  Tn  the  previous  anecdote,  the 
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*>’  clinician  would  have  done  better  to  realize  that  if  the  stu- 

>■’  dent  were  asking  seemingly  irrelevant  questions  s/he  was 

Cl  likely  floundering  around  and  in  need  of  help. 

♦ I 

DECIDE  HOW  TO  ALLOW  FOR  ALL  STUDENT  RESPONSES. 

Sometimes  students  say  what  you  want  them  to,  but  in  a 
different  way,  but  sometimes  they  say  something  that  you 
didn't  expect.  The  following  question  is  an  example  of  the 
former . 

Fill  in  the  blank. 

When  teaching  a concept,  it  is  important  to 

provide  examples  that  draw  attention  to  its  

attributes . 


The  lesson  author  may  expect  the  student  to  answer  with  the 
same  word  that  had  been  used  in  the  text  ("critical"),  and 
program  the  lesson  to  accept  only  that  answer  as  correct. 
However,  the  student  may  respond,  correctly,  with  such  words 
as  "defining"  or  "relevant."  The  lesson  developer  must  be 
prepared  to  accept  all  reasonable  alternatives  as  correct 
responses.  However,  rather  than  trying  to  anticipate  all 
possible  renditions,  allow  for  a few  obvious  ones,  then  try 
the  lesson  out  with  a few  trial  students,  adding  resonable 
responses  as  they  come  up. 

The  preceding  scenario  illustrates  the  second  point. 
Even  when  the  student's  response  is  totally  unexpected,  it 
needs  some  feedback.  The  easiest  solution  is  a catch-all 
phrase  of  some  sort  to  direct  the  student  back  to  your  line 
of  thinking  (while  keeping  a record  of  student  responses  and 
inserting,  alternative  responses  later  on). 
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Make  it  simple  for  the  student  to  know  what  to  do.  For 
example,  suppose  the  lesson  provides  a number  of  options  such 
as  going  on  to  the  next  exercise,  the  next  section,  the 
index,  or  to  a score  sheet.  Suppose,  too,  that  the  student 
must  press  a different  key  for  each  alternative.  Display  the 
information  where  it's  easy  to  see,  so  that  it  is  available 
when  the  student  needs  it.  Maybe  you  can  even  provide  it  on 
a handout,  or  have  it  posted  on  the  terminal.  The  objective 
of  the  lesson  is  to  help  the  student  learn  some  particular 
content,  not  to  see  if  s/he  can  find  his/her  way  around. 

Make  it  clear  just  what  form  of  the  answer  you  expect 
the  student  to  give.  For  example,  consider  the  following 
problem. 


Evaluate  1/2 

a)  12  b)  2 c)  .5  d)1.2 


You  may  expect  students  to  answer  with  a letter,  like  "c", 
but  it  is  not  unreasonable  for  them  to  simply  type  ".5".  If 
you  expect  them  to  respond  with  the  letter  of  their  choice, 
tell  them  so. 

Provide  an  adequate  set  of  directions.  Say  it  simply 
and  in  plain  English.  Try  to  keep  the  reading  level  at,  or 
below,  the  level  of  course  content.  Be  sure  to  include  all 
of  the  information  that  a student  at  the  target  level  will 
need  to  have.  Remember,  s/he  does  not  have  all  of  the  exper- 
ience or  knowledge  that  you  have,  and  may  need  to  be  told 
things  that  you  take  for  granted. 

DECIDE  HOW  TO  REPLY  TO  STUDENT  RESPONSES. 

Every  serious  student  response  needs  a meaningful  reply. 
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l *’  student?  answer  correctly,  tell  them  so  and  do  a little 
back-patting . Think  of  ways  to  encourage  students  when  they  1 

are  doing  well,  but  don’t  he  ind  i scr  irrinate . Getting  the  1 

j 

ri'-'ht  answer  after  two  or  three  tries  is  ok,  but  not  spectac-  | 

] 

ular.  °o  match  the  decree  of  enthusiasm  with  the  particular  I 

i 

situation.  j 

Responding;  to  a student's  wrong  response  is  considerably  j 

j 

different.  '-’hen  the  student  is  correct,  your  reply  can  sim-  j 

ply  center  on  the  quality  of  his/her  response,  but  when  the 

student  is  wrong,  your  reply  needs  to  center  on  the  content 

of  his/her  response.  Whereas  it's  perfectly  all  right  to  ; 

say,  "Yes,  you're  right,"  it's  not  usually  enough  to  simply 

say,  "go,  you're  wrong."  Let's  look  at  an  example  of  some  of  , 

the  sorts  of  feedback  you  can  give  if  the  student  is  wrong. 

Suppose  you  ask  the  following  question; 

"Fill  in  the  blank  with  the  appropriate  term. 

Organic  compounds  which  are  used  to  build  body 
tissue  are  called | 

von  have  at  least  four  choices  of  ways  to  respond  if  the  stu- 
dent answers  incorrectly.  First,  you  can  simply  tell  the  f J 

student  s/he  is  wrong.  Since  this  would  give  the  student 
absolutely  no  clue  as  to  why  s/he's  wrong,  it's  not  the  best 
alternative.  Gecond,  you  could  give  a syntactical  hint  such 

as,  "pr ."  This  might  be  helpful  if  the  student  were 

working  on  a crossword  puzzle,  but  isn’t  very  meaningful  in 
this  sort  of  situation.  A third  alternative  is  to  provide  a 
general,  all-purpose  response  for  all  wrong  answers  such  as, 

"These  compounds  are  composed  of  many  amino  acids."  This 
provides  more  elaboration  and  gives  the  student  a substantial 
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hint.  T you  I'-mt  to  he  even  more  attentive,  however,  you 
can  loo1;  at  the  student's  answer  and  respond  spec  i fi  ca]  1 v to 
that.  ror  example,  if  the  student  had  answered,  "carbohy- 
drates", you  might  reply,  "Carbohydrates  provide  energy  ratv^r 
than  build  body  tissue.  "lie  compounds  we’re  interested  in 
are  composed  of  many  amino  acids."  This  tells  the  student 
why  s/he's  wrong  arui  gives  more  information  about  the  correct 
answer . 

I'ow  much  detail  you'll  want  to  po  into  will  depend  both 
on  the  difficulty  of  the  material  and  on  the  questionninp 
technique  you're  using.  For  example,  in  a mathematics  drill 
it  can  he  enouph  to  sim-ply  tell  the  student  the  ripht 
answer.  If  the  student  made  a common  error  (such  as  addinc 
rather  than  mul ti pi y ing ) , you  could  point  that  out.  As 
interactions  become  more  complicated,  the  student  who  has 
responded  incorrectly  will  need  a fuller  explanation  either 
of  why  his/her  answer  is  wrong  or  more  elaborate  help  to 
arrive  at  the  correct  answer. 

V'e've  assumed  here  that  the  student  has  responded  uefore 
any  feedback  is  piven.  Sometimes,  without  thinking,  authors 
pive  the  student  the  correct  answer  even  before  the  student 
gives  an  answer  of  his/her  own.  Feedback  is  most  effective 
when  the  student  first  gives  a serious  (rather  than  nonsensi- 
cal) response. 

PPG  I nr  not;  TO  ggt  STypFbTS  KNOW  !!0V  T"FY'PF  mir. 

In  the  course  of  normal  classroom  interaction,  students 
are  able  to  ret  a sense  of  how  well  they're  doing  compared  to 
their  classmates.  however,  working  alone  in  C/'T,  they  have 
no  way  of  petting  this  information.  Students  workinr  in  CAT 
have  found  it  very  useful  arid  desirable  to  have  status  data 
available  on  request.  This  can  include  a record  of  the  stu- 
dent's performance,  a record  of  how  s/he  stands  relative  to 
the  rest  of  the  class,  or  simply  information  about  v'-at  s/he 
has  accomplished  and  what  s/he  has  left  to  do. 
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MYTH:  LESSON  DEVELOPMENT  IS  A ONE-SHOT  EFFORT. 

At  one  fledgling  CAI  site , the  staff  (entirely  composed 
of  novice  authors)  disregarded  consultants'  warnings  that 
lesson  development  was  an  iterative  rather  than  a one-time- 
around  process.  Though  the  consultants  stressed  the  impor- 
tance of  numerous  trial  runs  before  actual  student  runs , the 
authors  felt  that  by  having  a couple  colleagues  go  through 
their  lessons  they  could  eliminate  virtually  all  programming 
or  design  errors.  Since  the  authors  were  not  yet  familiar 
enough  with  the  medium  to  recognize  potential  pitfalls , their 
comments  (usually  rendered  on  the  basis  of  only  one  trip 
through  the  lesson)  almost  invariably  focused  on  inconsequen- 
tial bugs  such  as  spelling  or  punctuation  errors.  Authors, 
however , interpreted  this  dearth  of  useful  criticism  as  an 
indication  that  their  lessons  were  largely  free  of  flaws  and 
that  these  cursory  critiques  were  indeed  all  that  was  really 
necessary.  Thus  armed  with  their  comrades  blessings , the 
authors  sallied  forth , confidently  unleashing  their  lessons 
on  the  unsuspecting  students. 

Within  days  at  least  one  student  was  labeled  an  "atti- 
tude problem"  and  threatened  with  disciplinary  action  (he  had 
complained  because , after  over  an  hour  in  a lesson,  a pro- 
gramming error  near  the  end  kicked  him  out  and  jumped  him 
back  to  the  very  beginning , requiring  that  he  go  through  the 
entire  lesson  again).  Authors  found  themselves  frantically 
fixing  errors  as  fast  as  they  were  reported  so  that  students 
could  either  get  out  of  or  get  into  various  portions  of  les- 
sons. Students  were  maddeningly  stymied  by  questions  which 
left  them  stuck  in  a lesson  with  no  idea  what  to  respond,  no 
clues  or  help,  and  no  way  to  either  move  backward  or  forward 
within  the  lesson.  Within  5 months  there  was  a virtually 
unanimous  student  mutiny,  with  nearly  all  asking  to  be  reas- 
signed to  a non-CAI  class. 


nearly  all  creative  work  involves  an  iterative  process, 
'■'r  iters  write  first,  soconi  and  even  third  drafts  before 


[ f,'|  their  hooks  are  published.  /'rchitects  draw  sketch  after 

' V'  sketch  before  settling  on  a design  for  a building.  Any  time 

there  are  choices  to  be  made  cr  more  than  one  way  to  go  about 
[ v something,  the  final  product  is  a result  of  successive 

: ‘ approximations,  doing  and  redoing,  trying  out  and  scrapping, 

; v until  the  end  result  "works".  A prime  requisite  in  this  pro- 

cess is  feedback  from  various  sources.  A writer  can  send  a 

\ PV 

i V book  to  his/her  editor,  or  an  architect  can  show  his/her 

' * sketches  to  colleagues.  A CAI  author,  though,  has  a peculiar 

l *.*  problem.  A book  or  sketch  can  be  criticized  in  its  entirety. 

the  critiouer  having  seen  al 1 the  finished  product.  A lesson 

however,  can  be  so  individualized  that  each  successive  person 

l. 

going  through  it  may  see  a slightly  different  lesson  than  the 
previous  person.  rach  person  will,  therefore,  have  seen  some 
(not  all)  of  the  lesson.  People  may  answer  questions  differ- 
ently and  thus  get  different  feedback  for  their  responses, 
fome  people  need  help  at  certain  junctures  while  others  do 
not.  Tf  the  student  is  allowed  to  control  his/her  own  path 
through  the  lesson,  each  may  take  a slightly  different  direc- 
tion. fnd  all  these  variables  are  fraught  with  ambushes. 
Feedback  to  student  responses  may  be  inadequate  or  unclear; 
remediation  may  be  incomplete  or  superfluous;  certain 
sequencing,  may  seem  jumbled  or  disorganized.  A handful  of 
colleagues  going  through  a lesson  can't  possibly  pin  down  all 
the  potential  pitfalls.  The  best  solution  is  to  try  the  les- 
j:  son  out  on  lots  of  students  before  you  give  it  to  the  stu- 

[ dents  it  was  written  for--not  because  you  want  lots  of  "dif- 

I " fcrent  opinions",  but  because  the  more  people  who  go  through 

| it,  the  more  errors  and  oversights  will  be  uncovered. 
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Fometincs  an  id <=•  a sennas  reallv  good,  but  when  you  put  it 
on  a computer  it  doesn't  seer;  to  fulfill  its  prorise.  If  you 
try  out  parts  of  the  lesson  rather  than  trying  to  do  the 
whole  thine  at  once,  you  can  prevent  havinr  to  overhaul  or 
scrap  large  portions  of  work  because  some  fundamental  defi- 
ciencies in  the  lesson  were  not  discovered  until  after  the 
lesson  was  "finished."  In  the  long  run,  the  most  efficient 
way  to  write  a lesson  is  to  plan  right  from  the  beginning  to 
evaluate  the  lesson  and  revise  it  as  you  go  along.  This  is 
called  "formative  evaluation"  --  evaluation  for  the  purpose 
of  improving  or  polishing  the  lesson  as  it  is  being  written 
(rather  than  as  a whole  after  it's  completely  coded). 

There  are  a number  of  questions  you  should  he  seeking  to 
answer  in  evaluating  your  lesson.  ror  instance, 


t 
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— is  the  content  accurate? 

--are  there  programming  errors? 

— are  there  places  where  students  can  get 
stuck  with  no  available  help? 

--are  there  questions  where  students  answer 
correctly  hut  are  judged  as  incorrect? 

There  are  at  least  three  major  sources  for  answering 
these  questions:  peer  reviews,  student  trials,  and  on-line 
data  collection.  Fach  serves  a different  purpose  and  should 
really  not  be  used  as  a substitute  for  any  of  the  others. 

Peer  reviews . Colleagues  can  help  you  by  checking  on  content 
accuracy.  They  can  also  "ivo  suggestions  on  alternate  or 
better  methods  of  presentation. 


ftim'ent  trials.  °ne  objective  of  student  trials  is  to  find 
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out  whether  the  student  can  g et  through  the  lesson  without 
you1"  standing  over  his/her  head  and  telling  saying,  "That's 
not  wh.at  I meant.  Mere’s  the  way  you're  supposed  to  do  that." 
hther  objectives  are  to  locate  particular  problem  spots  or 
programming  errors,  and  to  identify  additional  prerequisite 
skills  that  may  be  necessary  in  order  for  the  student  to  suc- 
cessfully complete  the  lesson. 

While  it's  difficult  to  state  a specific  rule  for  how 
many  students  should  go  through  your  lesson,  one  clue  is  the 
number  of  errors  or  possible  revisions  you  find  with  each 
student  trial.  As  long  as  you  continue  to  uncover  important 
flaws,  you  should  continue  to  revise  and  student-test  the 
lesson  again  and  again.  Using  just  a few  students  at  a time 
makes  revision  less  awesome. 

Always  retest  a lesson  after  you've  made  revisions. 
Sometimes  revisions  don't  solve  the  problem,  or  in  trying  to 
fix  one  error  an  author  inadvertantly  creates  another  error. 

fata  col  lection . The  computer  can  collect  information  for 
you  on  such  matters  as  lesson  completion  times,  incorrect 
responses,  error  rates,  and  general  performance.  These  can 
serve  as  a basis  for  intelligent  decisions  about  the  kinds  of 
revisions  that  need  to  be  made. 

Some  measures  of  lesson  quality  that  can  he  detected 
through  on-line  data  are:  percentage  of  students  who  pass  an 
end-of-lesson  test  after  going  through  the  lesson  once,  per- 
centage of  students  who  do  not  complete  the  lesson,  and  the 
number  of  times  students  repeat  the  lesson. 

>'ow  Po  You  Know  The  Lesson  Is  Ready  For  General  Use? 

When  there  are  no  programming  errors,  students  can  com- 
plete the  material  within  an  allotted  time,  and  students  are 
able  to  get  through  the  lesson  without  cominm  to  a dead  end, 
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you  can  ber.in  to  thin!-  n>’out  wsine  the  lesson  with  "real” 
students . 


SUMMARY  CHECKLIST 


Planning 

--  Are  performance  goals  clearly  stated? 

--  Is  there  an  end-of-lesson  test? 

- Are  questions  ppropriate  to  desired  performance  level? 

- Are  there  too  few  or  too  many  questions? 

--  Do  you  have  a lesson  evaluation  plan? 

Content 

--  What  instructional  approach(es)  are  you  using? 

- Drill? 

- Tutorial? 

- Inquiry? 

- Simulation? 

- Game? 

--  How  much  autonomy  does  the  student  have? 

--  Are  there  questions  throughout  the  lesson? 

--  Is  transition  smooth  between  ideas? 

Displaying  Material 

--  Is  there  too  much  material  on  the  screen? 

--  Are  important  words  or  ideas  highlighted? 

--  Does  the  screen  ever  write  at  two  places  at  once? 

--  Is  the  student  allowed  to  read  at  his/her  own  pace? 

Student  Responses 

--  Are  directions  clear? 

— Have  you  allowed  for  a variety  of  responses? 

--  Does  feedback  give  added  help  or  information? 

--  Do  you  let  students  know  how  they're  doing? 
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Evaluating  Your  Lesson 

--  Are  there  content  errors? 

--  Are  there  programming  errors? 

--  Can  students  get  stuck  with  no  available  help? 

--  Are  students'  answers  ever  judged  as  wrong  when  they're 
correct? 

--  Have  colleagues  been  through  your  lesson? 

--  Has  the  lesson  been  pretested  by  trial  runs? 

--  Are  you  collecting  student  performance  data? 

--  Do  you  review  student  data  frequently? 
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